Risk-Sensitive Filtering and Smoothing for Continuous-Time Markov Processes
نویسندگان
چکیده
منابع مشابه
Risk-Sensitive Markov Control Processes
We introduce a unified framework to incorporate risk in Markov decision processes (MDPs), via prospect maps, which generalize the idea of coherent/convex risk measures in mathematical finance. Most of the existing risk-sensitive approaches in various literature concerning with decision-making problems are contained in the framework as special instances. Within the framework, we solve the optima...
متن کاملContinuous time Markov decision processes
In this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission con...
متن کاملSeries Expansions for Continuous-Time Markov Processes
We present update formulas that allow us to express the stationary distribution of a continuous-time Markov process with denumerable state space having generator matrix Q∗ through a continuous-time Markov process with generator matrix Q. Under suitable stability conditions, numerical approximations can be derived from the update formulas, and we show that the algorithms converge at a geometric ...
متن کاملRisk-Sensitive Filtering and Smoothing via Reference Probability Methods
In this paper, we address the risk-sensitive filtering problem which is minimizing the expectation of the exponential of the squared estimation error multiplied by a risk-sensitive parameter. Such filtering can be more robust to plant and noise uncertainty than minimum error variance filtering. Although optimizing a differently formulated performance index to that of the so-called H1 filtering,...
متن کاملMore Risk-Sensitive Markov Decision Processes
We investigate the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite horizon which is generated by a Markov Decision Process (MDP). The certainty equivalent is defined by U−1(EU(Y )) where U is an increasing function. In contrast to a risk-neutral decision maker this optimization criterion takes the variability of the cost into account. I...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2005
ISSN: 0018-9448
DOI: 10.1109/tit.2005.846405